Goto

Collaborating Authors

 error scenario


Mixed Reality Outperforms Virtual Reality for Remote Error Resolution in Pick-and-Place Tasks

Kumar, Advay, Simangunsong, Stephanie, Carreno-Medrano, Pamela, Cosgun, Akansel

arXiv.org Artificial Intelligence

This study evaluates the performance and usability of Mixed Reality (MR), Virtual Reality (VR), and camera stream interfaces for remote error resolution tasks, such as correcting warehouse packaging errors. Specifically, we consider a scenario where a robotic arm halts after detecting an error, requiring a remote operator to intervene and resolve it via pick-and-place actions. Twenty-one participants performed simulated pick-and-place tasks using each interface. A linear mixed model (LMM) analysis of task resolution time, usability scores (SUS), and mental workload scores (NASA-TLX) showed that the MR interface outperformed both VR and camera interfaces. MR enabled significantly faster task completion, was rated higher in usability, and was perceived to be less cognitively demanding. Notably, the MR interface, which projected a virtual robot onto a physical table, provided superior spatial understanding and physical reference cues. Post-study surveys further confirmed participants' preference for MR over other interfaces.


Dance of the ADS: Orchestrating Failures through Historically-Informed Scenario Fuzzing

Wang, Tong, Gu, Taotao, Deng, Huan, Li, Hu, Kuang, Xiaohui, Zhao, Gang

arXiv.org Artificial Intelligence

As autonomous driving systems (ADS) advance towards higher levels of autonomy, orchestrating their safety verification becomes increasingly intricate. This paper unveils ScenarioFuzz, a pioneering scenario-based fuzz testing methodology. Designed like a choreographer who understands the past performances, it uncovers vulnerabilities in ADS without the crutch of predefined scenarios. Leveraging map road networks, such as OPENDRIVE, we extract essential data to form a foundational scenario seed corpus. This corpus, enriched with pertinent information, provides the necessary boundaries for fuzz testing in the absence of starting scenarios. Our approach integrates specialized mutators and mutation techniques, combined with a graph neural network model, to predict and filter out high-risk scenario seeds, optimizing the fuzzing process using historical test data. Compared to other methods, our approach reduces the time cost by an average of 60.3%, while the number of error scenarios discovered per unit of time increases by 103%. Furthermore, we propose a self-supervised collision trajectory clustering method, which aids in identifying and summarizing 54 high-risk scenario categories prone to inducing ADS faults. Our experiments have successfully uncovered 58 bugs across six tested systems, emphasizing the critical safety concerns of ADS.


Poka -- Yoking your ML Model

#artificialintelligence

A very popular notion in quality management is the notion of Poka-Yoke. It is invented in Japan for ensuring quality. Poka-Yoke means'mistake-proofing' or more literally -- avoiding (yokeru) inadvertent errors (poka). In context of our daily lives there are several instances of Poka-Yoke in action. To consider the popular example, let us see what happens when you try to enter an elevator suddenly, the sensor in the doors detects your presence and causes the doors to open.